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(54) Image processing apparatus and method, and recording medium 



(57) An optimum data arrangement is provided such 
that each apparatus can efficiently deal with image data 
encoded using discrete wavelet transform. For that pur- 
pose, an image processing apparatus includes an input 
device for inputting first entropy encoded data. The first 
entropy encoded data is obtained by performing entropy 
encoding of transform coefficients of a first data ar- 
rangement, obtained by performing wavelet transform 
of a predetermined image in each first unit. The appa- 



ratus also includes an arrangement changing device for 
performing entropy decoding of the first entropy encod- 
ed data, and changing the obtained transform coeffi- 
cients of the first data arrangement into transform coef- 
ficients of a second data arrangement, obtained by per- 
forming wavelet transform of the predetermined image 
in each second unit, and an entropy encoder for gener- 
ating second entropy encoded data by performing en- 
tropy encoding of the transform coefficients of the sec- 
ond data arrangement. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image 
processing apparatus and method for encoding/decod- 
ing an image, and a storage medium storing this meth- 
od. 

Description of the Related Art 

[0002] In accordance with recent remarkable devel- 
opments in computers and networks, various kinds of 
sets of information, such as character data, image data, 
voice data and the like, are stored within a computer or 
transmitted between networks. 

[0003] Among these data, an image, particularly a 
multivalue image, includes a very large amount of infor- 
mation. Hence, when storing/transmitting an image, the 
amount of data is very large. Accordingly, when storing/ 
transmitting an image, high-efficiency encoding is 
adopted in which the amount of data is reduced by re- 
moving redundancy of the image, or changing the con- 
tents of the image to such a degree that degradation of 
the picture quality is hardly recognized visually. 
[0004] A JPEG (Joint Photographic Experts Group) 
method recommended by ISO (International Organiza- 
tion for Standardization) and ITU-T (International Tele- 
communication Union - Telecommunication Standardi- 
zation Sector) is widely used as an internationally stand- 
ardized high-efficiency encoding method. The JPEG 
method is based on discrete cosine transform, and has 
a problem such that block-shaped distortion is generat- 
ed when increasing the rate of compression. 
[0005] On the other hand, in apparatuses for inputting 
or outputting images, a higher rate of compression than 
in conventional cases is being requested, because high- 
er resolution is required in order to improve the picture 
quality. I n order to deal with such a request, an encoding 
method utilizing discrete wavelet transform has been 
proposed as a transform method different from the 
above-described discrete cosine transform. 
[0006] The encoding method utilizing discrete wave- 
let transform has an advantage such that block-shaped 
distortion causing a problem in the above -de scribed 
method utilizing discrete cosine transform seldom oc- 
curs. 

[0007] Usually, in the above-described compression 
encoding method utilizing discrete wavelet transform, 
processing of transforming an image to be encoded is 
executed after storing the image in a frame memory for 
one picture frame, and data for one picture frame after 
being transformed is stored in the same frame memory 
or in another frame memory. 

[0008] The frame memory used in this case can be 
easily secured in a system based on a computer, but is 



difficult to secure in a relatively inexpensive peripheral 
apparatus, such as a digital camera, a scanner, a printer 
or the like, due to limitations in circuit scale. 
[0009] In such a case, the present invention is advan- 
s tageous because an image to be encoded or com- 
pressed data of the image is desirably subjected to se- 
quential transform processing (compression encoding) 
in units smaller than one picture frame, instead of being 
stored in a frame memory. 
10 [0010] In consideration of various types of editing 
processing to be performed for an image to be encoded 
or encoded data, it is desirable to divide the image to be 
encoded or the encoded image into units smaller than 
one picture frame, particularly, in units of a block, corn- 
's prising n x m pixels or the like, so as to easily assign a 
region in two-dimensional directions. 

SUMMARY OF THE INVENTION 

20 [0011] It is a concern of the present invention to solve 
the above-described problems. 

[0012] It is another concern of the present invention 
to provide an optimum data arrangement for image data 
encoded using discrete wavelet transform so as to be 
efficiently dealt with in each apparatus. 
[0013] It is still another concern of the present inven- 
tion to provide a method for obtaining, when dealing with 
image data encoded using discrete wavelet transform, 
image data having an optimum data arrangement which 
takes into consideration the capacity of a memory pro- 
vided in an apparatus dealing with the image data. 
[0014] It is yet another concern of the present inven- 
tion to provide a method for changing, when dealing with 
image data encoded using discrete wavelet transform 
so as to be adapted to an apparatus having a small 
memory capacity, the arrangement of the image data to 
an arrangement such that various types of image 
processing can be easily performed in a desired two- 
dimensional region. 

[0015] According to one aspect of the present inven- 
tion, an image processing apparatus includes input 
means for inputting first entropy encoded data corre- 
sponding to an image. The first entropy encoded data 
is data produced by entropy encoding a first set of trans- 
form coefficients obtained by performing wavelet trans- 
form of the image in units of a first type. The apparatus 
also includes arrangement changing means for entropy 
decoding the first entropy encoded data to obtain the 
first set of transform coefficients and for changing the 
first set of transform coefficients into a second set of 
transform coefficients corresponding to the result of per- 
forming wavelet transform of the image in units of a sec- 
ond type, and entropy encoding means for generating 
second entropy encoded data by entropy encoding the 
second set of transform coefficients. 
[0016] According to another aspect of the present in- 
vention, an image processing apparatus includes input 
means for inputting first entropy encoded data corre- 
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sponding to an image. The first entropy encoded data 
is data produced by entropy encoding a first set of trans- 
form coefficients obtained by performing wavelet trans- 
form of the image in units of a first type. The apparatus 
also includes arrangement changing means for entropy s 
decoding the first entropy encoded data to obtain the 
first set of transform coefficients and for changing the 
first set of transform coefficients into a second set of 
transform coefficients corresponding to the result of per- 
forming wavelet transform of the image in units of a sec- 10 
ond type, and entropy encoding means for generating 
second entropy encoded data by entropy encoding the 
second set of transform coefficients. Furthermore, the 
apparatus includes an additional arrangement changing 
means for performing entropy decoding of the second is 
entropy encoded data to obtain the second set of trans- 
form coefficients and for changing the second set of 
transform coefficients into a third set of transfor coeffi- 
cients corresponding to the result of performing wavelet 
transform of the image in units of a third type, and addi- 20 
tional entropy encoding means for generating third en- 
tropy encoded data by entropy encoding the third set of 
transform coefficients. 

[001 7] According to yet another aspect of the present 
invention, an image processing method includes an in- 25 
put step of inputting first entropy encoded data corre- 
sponding to an image. The first entropy encoded data 
is data produced by entropy encoding a first set of trans- 
form coefficients obtained by performing wavelet trans- 
form of the image in units of a first type. The method 30 
also includes an arrangement changing step of entropy 
decoding the first entropy encoded data to obtain the 
first set of transform coefficients and of changing the first 
set of transform coefficients into a second set of trans- 
form coefficients corresponding to the result of of per- 35 
forming wavelet transform of the image in units of a sec- 
ond type, and an entropy encoding step of generating 
second entropy encoded data by entropy encoding the 
second set of transform coefficients. 

[0018] According to still another aspect of the present 40 
invention, in a storage medium storing an image 
processing program in a state of being readable by a 
computer, the program includes an input step of input- 
ting first entropy encoded data corresponding to an im- 
age. The first entropy encoded data is data produced by 46 
entropy encoding a first set of transform coefficients ob- 
tained by performing wavelet transform of the image in 
units of a first type. The program also includes an ar- 
rangement changing step of entropy decoding the first 
entropy encoded data to obtain the first set of transform so 
coefficients and of changing the first set of transform co- 
efficients into a second set of transform coefficients cor- 
responding to the result of performing wavelet transform 
of the image in units of a second type, and an entropy 
encoding step of generating second entropy encoded ss 
data by entropy encoding the second set of transform 
coefficients. 

[0019] The foregoing and other advantages and fea- 



tures of the present invention will become more appar- 
ent from the following description of the preferred em- 
bodiments taken in conjunction with the accompanying 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0020] 

FIG. 1 is a block diagram illustrating a system in- 
cluding an image processing apparatus according 
to a first embodiment of the present invention; 
FIG, 2 is a block diagram illustrating a system in- 
cluding an image processing apparatus according 
to a second embodiment of the present invention; 
FIGS. 3A - 3C are diagrams illustrating the config- 
uration and the operation of an external input appa- 
ratus; 

FIGS. 4A - 4C are diagrams illustrating the config- 
uration and the operation of another external input 
apparatus; 

FIGS. 5A - 5D are diagrams illustrating the config- 
uration and the operation of a code-string converter; 
FIGS. 6A - 6C are diagrams illustrating the config-* 
uration and the operation of another code-string 
converter; 

FIG. 7 is a block diagram illustrating the configura- 
tion of an external output apparatus; and 
FIG. 8 is a block diagram illustrating the configura- 
tion of an image encoder shown in FIG. 2. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0021] Preferred embodiments of the present inven- 
tion will now be sequentially described in detail with ref- 4 ' 
erence to the drawings. 

First Embodiment 

[0022] FIG. 1 is a block diagram illustrating the con- 
figurations of an image processing apparatus according 
to a first embodiment of the present invention, and an 
image input/output system using the apparatus. 
[0023] In FIG. 1, portion E1 represents an image 
processing apparatus which can change arrangement 
of encoded data. An external input apparatus 1 inputs 
or generates an image according to a predetermined 
method, performs compression encoding of the image 
using discrete wavelet transform, and outputs encoded 
data. The image processing apparatus E1 stores the en- 
coded data output from the external input apparatus 1 , 
and, for example, displays or edits the stored encoded 
data. The image processing apparatus E1 also outputs 
the encoded data to an external output apparatus 6, 
whenever necessary. 

[0024] For example, the external input apparatus 1 
comprises an image input apparatus, such as a digital 



3 



5 



EP 1 009 168 A2 



6 



camera or a scanner, the image processing apparatus 
E1 comprises a general-purpose computer, and the ex- 
ternal output apparatus 6 comprises a printer. 
[0025] In such an image processing system, only im- 
age data corresponding to a necessary partial region of 
an image input from the external input apparatus 1 , such 
as a digital camera or the like, is edited, processed or 
reviewed in a general-purpose computer. Then, the im- 
age data can be output to the external output apparatus 
6. 

[0026] The function of each block will now be de- 
scribed. In the following description, encoded data to be 
dealt with is obtained by encoding gray-scale black-and- 
white image data. However, the present invention is not 
limited to such data, but may also be applied to a case 
in which encoded data of a color image is dealt with. In 
such case, by repeatedly performing a processing pro- 
cedure of the first embodiment to each color signal, the 
same effects as in the first embodiment may also be ob- 
tained. 

[0027] FIGS. 3A - 3C are diagrams illustrating the 
configuration and the function of the external input ap- 
paratus 1 . FIG. 3A is a block diagram illustrating the con- 
figuration of the external input apparatus 1. In FIG. 3A, 
multivalue image data generated by an image input ap- 
paratus 1 01 is output to a buffer storage 1 02. The image 
input apparatus 101 comprises a sensor, such as a CCD 
(charge-coupled device) or the like. Analog multivalue 
image data is generated by reading an original or a land- 
scape by the CCD. The generated analog multivalue im- 
age data is converted into digital image data by an A/D 
(analog-to-digital) converter within the image input ap- 
paratus 101. The generated digital image data is tem- 
porarily stored in the buffer storage 102. 
[0028] The buffer storage 102 includes a first memory 
region capable of storing multivalue image data for at 
feast K lines input from the image input apparatus 1 , and 
a second memory region capable of storing transform 
coefficients for two lines input from a discrete wavelet 
transformer 103. 

[0029] The discrete wavelet transformer 103 per- 
forms known discrete wavelet transform for the multival- 
ue image data stored in the buffer storage 102, and gen- 
erates/outputs transform coefficients whose number 
equals the number of pixels represented by the multi- 
value image data. The generated transform coefficients 
can be classified into subblocks representing different 
types of frequency components. When performing dis- 
crete wavelet transform in units of a line, the size of each 
of the subblocks is usually 1/2 n (n is an integer equal to 
or larger than 1 ) of the size of the original image repre- 
sented by the multivalue image data. 
[0030] The discrete wavelet transform is executed by 
performing low-pass filtering processing and high-pass 
filtering processing for the input multivalue image data, 
and performing down sampling of output of each filter to 
1/2. Since the discrete wavelet transform is a known 
technique, further description thereof will be omitted. 



[0031] FIG. 3B is a diagram illustrating the operation 
of the discrete wavelet transformer 103. The discrete 
wavelet transformer 103 does not perform discrete 
wavelet transform while holding multivalue image data 

s for the entire input image. However, the discrete wavelet 
transformer 103 can obtain substantially the same con- 
tents as transform coefficients obtained by performing 
discrete wavelet transform while holding multivalue im- 
age for the entire image by performing filtering process- 

10 jng for a few lines corresponding to a part of the multi- 
value image. 

[0032] A case in which the input multivalue image da- 
ta represents M pixels in the vertical direction and N pix- 
els in the horizontal direction will be considered. 

*5 [0033] It is assumed that the external input apparatus 
1 shown in FIG. 1 does not include an expensive large- 
capacity buffer memory. Namely, the buff er storage 102 
or the like does not have a capacity for storing image 
data for one frame. Accordingly, as indicated by broken 

20 Hnes in FIG. 3B, data for K lines, which correspond to a 
minimum required number even when discrete wavelet 
transform is performed in units of a line, of the original 
multivalue image data input from the image input appa- 
ratus 101 is appropriately stored in the buffer storage 

25 102. Every time discrete wavelet transform for one line 
is completed, currently stored data for the oldest line of 
the multivalue image data is deleted in the first memory 
region, and data for one new line of the multivalue image 
data is input from the image input apparatus 1 and is 

30 stored in the buffer storage 102. The input/output of the 
multivalue image data is performed in the sequence of 
raster scanning. 

[0034] The value K is automatically determined based 
on the number of taps of filters used in discrete wavelet 
35 transform, and corresponds to the number of lines nec- 
essary for decomposition of one level (corresponding to 
processing of decomposing the original image into a 
subblock LL obtained by passing the image through a 
low-pass filter in two-dimentional directions, two sub- 
blocks LH and HL obtained by passing the image 
through a low-pass filter in one dimension and through 
a high-pass filter in another dimension, and a subblock 
HH obtained by passing the image through a high-pass 
filter in two-dimensional directions). 
4S [0035] The discrete wavelet transformer 103 per- 
forms encoding processing for data of a center line from 
among the multivalue image data for K lines within the 
buffer storage 1 02. By referring to multivalue image data 
for other lines for the data of the center line, filtering in 
so the vertical direction is performed using a low-pass filter 
and a high-pass filter, and a low-pass-filter output L and 
a high-pass-filter output H corresponding to the amount 
of data for two lines are output. The filter outputs L and 
H for two lines are temporarily stored in the second 
55 memory region of the buffer storage 102. 

[0036] Then, low-pass filtering and high-pass filtering 
are also performed in the horizontal direction for the two 
filter outputs L and H in the vertical direction. As a result, 
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as shown in FIG. 3B, four outputs having a length of N/ 
2, i.e., LL1 , LH1 , HL1 and HH1 are calculated. These 
outputs are overwritten on the filter outputs L and H in 
the second memory region. 

[0037] These outputs are obtained by decomposing 
the input multivalue image data into the above-de- 
scribed plurality of types of frequency bands. Usually, 
these frequency bands are called subbands. 
[0038] Three subbands belonging to high-frequency 
components (bands), i.e., LH1, HL1 and HH1, are no 
longer subjected to discrete wavelet transform, and 
therefore are immediately output from the buffer storage 
102 to a quantizer 104 provided at the succeeding 
stage. The data LL1 belonging to a lowest-frequency 
component is further subjected to frequency decompo- 
sition of the next level according to the similar process- 
ing (processing of decomposing the data into four sub- 
bands). Thus, four outputs having a length of N/4, i.e., 
LL2, LH2, HL2 and HH2, are calculated in addition to 
the three subbands previously transmitted to the quan- 
tizer 1 04, and are output to the quantizer 1 04 after being 
temporarily stored in the buffer storage 102. Thus, dis- 
crete wavelet transform for multivalue image data for 
one line is completed. This processing is repeated for 
all lines. 

[0039] According to the above-described processing, 
the data LL1 or LL2 corresponding to the lowest-fre- 
quency component at each level is data corresponding 
to a reduced image of the original multivalue image. 
[0040] In the configuration shown in FIGS. 3A and 3B, 
since the capacity of the buffer storage 102 is small, in 
the above-described frequency decomposition process- 
ing in units of a line, the high-frequency components 
LH1, HL1 andHHI for which decomposition processing 
has been terminated are first output to the quantizer 
104. Then, after opening the second memory region as 
much as possible, the low-frequency components LL2, 
LH2, HL2 and HH2 are generated in the memory. In such 
an output sequence, it is impossible to output hierarchi- 
cal encoded data for which the decoding side can rec- 
ognize the outline of an image to be encoded at an early 
stage, i.e., to output a certain image region from low- 
frequency components to high-frequency components. 
[0041] In the first embodiment, by performing two-lev- 
el discrete wavelet transform of input multivalue image 
data for each line, the storage capacity of the buffer stor- 
age 102 which is usually required for this transform 
processing is reduced. However, the present invention 
is not limited to such an approach, but may perform 
transform with arbitrary levels in accordance with the en- 
tire compression encoding method or the contents of the 
image. 

[0042] Then, the quantizer 1 04 quantizes image data 
(transform coefficients) corresponding to the input sub- 
bands LH1 , HL1, HH1, LL2, LH2, HL2 and HH2 with a 
predetermined method, and sequentially outputs quan- 
tized values. A known technique, such as scalar quan- 
tization, vector quantization or the like, may be utilized 



for this quantization. 

[0043] One type of quantization step may be used. 
However, efficient encoding in which human visual 
sense is taken into consideration can be realized by us- 
5 ing a quantization step having a large width for sub- 
bands of high-frequency components and using a quan- 
tization step having a relatively small width for subbands 
of low-frequency components, in consideration of val- 
ues of frequency components represented by respec- 

10 tive subbands. 

[0044] Quantized values for respective subbands out- 
put from the quantizer 104 are temporarily stored in a 
buffer storage for encoding 105 in units of a subband 
belonging to the same frequency band. Then, an entro- 

15 py encoder 1 06 refers to the quantized values within the 
buffer storage for encoding 105, and outputs encoded 
data obtained by performing entropy encoding of the 
quantized values so as to store the data in the same 
region or a different region of the buffer storage for en- 

20 coding 105. Arithmetic encoding, Huffman encoding or 
the like may be used as the entropy encoding. 
[0045] FIG. 3C illustrates the structure of the encoded 
data generated in the above-described manner. In FIG. 
3C, a header includes additional information, such as. 

25 the size of the image input to the image input apparatus 
101 , the number of color components, a flag indicating . 
that encoding is performed in units of a line, and the like. 
After the header, encoded data obtained by encoding 
respective lines of the multivalue image data according 

30 to the above -described method are sequentially ar- 
ranged from the first line. 

[0046] In the first embodiment, quantized values cor- 
responding to each line are subjected to entropy encod- 
ing independently for each line. Namely, the encoding 
35 operation of the entropy encoder 1 06 is reset in units of 
a line. 

[0047] However, the present invention is not limited to 
such an approach. Quantized values corresponding to 
each line may be subjected to entropy encoding not 

40 completely independently. Namely, when executing 
arithmetic encoding, the encoding operation of the en- 
tropy encoder 106 may not be reset in units of a line, but 
may continue for a few lines in the order of raster scan- 
ning. It is thereby possible to perform compression en- 

45 coding with a higher compression ratio by utilizing over- 
all correlation of the original multivalue image. The en- 
coded data shown in FIG. 3C is output to a switcher 2 
shown in FIG. 1 . 

[0048] In the foregoing description, in the image input 
50 apparatus 1 , discrete wavelet transform and entropy en- 
coding are performed in units of a line (in the order of 
raster scanning) of the original image. 
[0049] However, as for encoded data obtained in the 
above-described encoding method, there is a problem 
55 such that it is necessary to refer to encoded data for a 
horizontal width (including n pixels) of one picture frame 
even when editing only a partial region having arbitrary 
vertical and horizontal widths of a coordinate. In addi- 
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tion, it is impossible to obtain the basic effect of discrete 
wavelet transform of allowing hierarchical reproduction 
by performing transmission/reception in the order from 
encoded data corresponding to low-frequency compo- 
nents to encoded data corresponding to high-frequency 
components. In order to obtain such an effect, it is nec- 
essary to perform wavelet transform or entropy encod- 
ing in units of a block smaller than one picture frame 
comprising MxN pixels in two-dimensional directions. 
[0050] FIGS. 4A - 4C are diagrams illustrating the 
configuration of a block for performing encoding using 
discrete wavelet transform with a unit different from the 
configuration of the external input apparatus 1 shown in 
FIG. 3A t i.e., in units of a block smaller than the vertical 
and horizontal widths for one picture frame in two-di- 
mensional directions, and the encoding operation. In the 
following description, it is assumed that a square block 
comprising W x W pixels is used as the unit of the block. 
However, the present invention is not limited to such a 
case. A nonsquare block may also be used. 
[0051] An external input apparatus 1 in this case may 
be considered to be, for example, a high-grade digital 
camera having a large-capacity memory. A buffer stor- 
age 102 shown in FIG. 4A can store multivalue image 
data comprising at least W x N pixels, and therefore has 
a capacity larger than the buffer storage 102 shown in 
FIG. 3A. Accordingly, the buffer storage 102 can assur- 
edly perform discrete wavelet transform in units of W x 
W pixels, where K < W, and, as a result, can easily per- 
form image editing in units of a block comprising W x W 
pixels. It is assumed that W is a number sufficiently 
smaller than M and N. 

[0052] In FIG. 4A, the basic circuit configuration is 
identical to the circuit configuration of the external input 
apparatus 1 performing encoding in units of a line shown 
in FIG. 3A. However, the unit of discrete wavelet trans- 
form by a discrete wavelet transformer 103 differs from 
the above-described case, i.e., discrete wavelet trans- 
form is performed in units of a block of a predetermined 
size of W x W pixels instead of in units of a line (the order 
of raster scanning). As shown in FIG. 4B, transform co- 
efficients after discrete wavelet transform in units of W 
x W pixels generate LL2, LH2, HL2, HH2, LH1, HL1 and 
HH1, which are written in the buffer storage 102. The 
obtained transform coefficients in units of W x W pixels 
are also used in quantization processing and entropy 
encoding processing at the succeeding stages. 
[0053] FIG. 4C illustrates the configuration of encod- 
ed data obtained by encoding processing of the circuitry 
shown in FIG. 4A. As in the above-described case of 
encoding processing in units of a line, a header includes 
additional information, such as the size of the image in- 
put to the image input apparatus 101, the number of 
color components, a flag indicating that encoding is per- 
formed in units of a line, and the like. After the header, 
encoded data obtained by independently encoding re- 
spective blocks having the size of W x W pixels are se- 
quentially provided. Symbol BH represents the header 



of each block, and includes information necessary for 
the unit of each block, such as the code length in each 
block, and the like. Thus, each block can be independ- 
ently decoded in decoding processing. 

s [0054] By encoding data in the above-described unit, 
it is possible to easily edit only a partial region smaller 
than the vertical and horizontal widths of one picture 
frame in two-dimensional directions. For example, it is 
possible to extract only encoded data of some blocks 

10 corresponding to a block whose region is assigned with 
desired vertical and horizontal widths from among the 
encoded data, and to decode/edit/again encode only the 
extracted encoded data. 

[0055] Since data can be output after quantization in 
'5 the succeeding stage in the order of LL2, LH2, HL2, 
HH2, LH1, HL1 and HH1 for each block having the size 
of Wx W pixels, it is possible to perform image decoding/ 
reproduction such that the reproduced image gradually 
changes from low picture quality (an image generated 
20 only from low-frequency components) to high picture 
quality (an image generated using all frequency compo- 
nents) for each block. 

[0056] Since the buffer storage 102 shown in FIG. 4A 
has a capacity of at least Wx N pixels, such hierarchical 
25 output may be performed for each band comprising W 
x N pixels. In such a case, data LL2 of Blocks #1 - #S 
are first output. Then, data LH2, HL2 and HH2 of each 
block are output, followed by output of data LH1, HL1 
and HH1 of each block. 
30 [0057] The switcher 2 shown in FIG. 1 receives en- 
coded data from the external input apparatus 1, and out- 
puts the encoded data to a code-string converter 3 or a 
storage device 4 at the succeeding stage. The switching 
operation of the switcher 2 is performed in accordance 
with control input of one of a control signal from the ex- 
ternal input apparatus 1 and a manual instruction from 
the user. 

[0058] The control signal from the external input ap- 
paratus 1 may be included in the above-described en- 
coded data, or may be received through a separately 
provided control line. In either case, the control input in- 
dicates whether encoding has been performed in the ex- 
ternal input apparatus 1 in units of a line or in units of a 
block. It can be considered that this control input indi- 
cates the capacity of the buffer storage required for en- 
coding in the external input apparatus 1 . 
[0059] When encoding has been performed in units 
of a line, in order to obtain encoded data (discrete wave- 
let transform coefficients) in units of a block preferred in 
a superior-function image processing apparatus, the 
switcher 2 outputs the input encoded data to the code- 
string converter 3. When encoding has been performed 
in units of a block, the input encoded data is output to 
the storage device 4 without being modified. The code- 
string converter 3 will now be described. 
[0060] FIGS. 5A - 5D illustrate the configuration and 
the operation of the code-string converter 3. FIG. 5A il- 
lustrates the internal configuration of the code-string 
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converter 3. Original quantized values are obtained by 
decoding the encoded data input from the switcher 2 by 
an entropy decoder 301. Then, a coefficient arranger 
302 rearranges the quantized values in a data arrange- 
ment which will be obtained when performing discrete s 
wavelet transform for each two-dimensional block (com- 
prising W x W pixels in this description). Then, an en- 
tropy encoder 303 again performs entropy encoding of 
the quantized values in this new data arrangement, and 
outputs resultant data to the succeeding stage. 10 
[0061] FIGS. 5B and 5C illustrate the operation of the 
coefficient arranger 302. The quantized values output 
from the entropy decoder 301 are temporarily stored in 
a buffer storage within the coefficient arranger 302. 
[0062] As shown in FIG. 5B, this buffer storage has a is 
length equal to or larger than the number of pixels N of 
the input multivalue image data in the horozintal direc- 
tion, and has a size equal to or larger than W lines in the 
vertical direction. The input quantized values are se- 
quentially written in this buffer storage. At that time, 20 
quantized values belonging to the same subband are 
written in an arrangement so as to be spatially adjacent 
to each other. For example, a series of quantized values 
corresponding to LL2 when performing discrete wavelet 
transform of input multivalue image data are written in 2s 
units of an input line at an upper left portion in FIG. 5B. 
After storing input multivalue image data for a predeter- 
mined number of lines (W in this case) in the buffer stor- 
age within the coefficient arranger 302 in the above-de- 
scribed manner, the stored data is changed to quantized 30 
values in the same data arrangement as when perform- 
ing discrete wavelet transform in units of a block com- 
prising W x W pixels. 

[0063] Namely, the coefficient arranger 302 reads 
quantized values stored in the internal buffer storage as 35 
shown in FIG. 5B in an order different from the order 
when inputting the quantized values (i.e., a data ar- 
rangement obtained when performing discrete wavelet 
transform in units of a block comprising W x W pixels), 
and outputs the read quantized values to an entropy en- 40 
coder 303 at the succeeding stage. 
[0064] FIG. 5C illustrates the data reading method at 
that time. Quantized values corresponding to a region 
comprising W x W pixels are read from the buffer stor- 
age. At that time, quantized values corresponding to the 45 
first level of discrete wavelet transform are read for each 
length of W/2, and quantized values corresponding to 
the second level of discrete wavelet transform are read 
for each length of W/4, as shown in FIG. 5B. The read 
values are grouped in units of each subband, and are 50 
output to the entropy encoder 303 at the succeeding 
stage. 

[0065] The entropy encoder 303 performs entropy en- 
coding indenpendently in units of the input block com- 
prising W x W pixels, and outputs encoded data. FIG. 55 
5D illustrates the configuration of the encoded data, in 
which, after a header including the size of the input mul- 
tivalue image data, the number of color components, a 



flag indicating that encoding has been performed in 
units of a block, andthe like, encoded data in which each 
block is independently encoded is provided. In this case, 
a flag indicating the unit of encoding stored in header 
information as shown in FIG. 3C is rewritten. 
[0066] Symbol BH represents the header of each 
block, and includes information necessary for the unit of 
each block, such as the code length in each block, and 
the like. Thus, each block can be independently decod- 
ed in decoding processing. The encoded data is output 
to and stored in the storage device 4. 
[0067] As described above, whether encoded data in- 
put to the image processing apparatus E1 is encoded 
data obtained by performing discrete wavelet transform 
in units of a line or encoded data obtained by ordinary 
encoding in units of a block, encoded data stored in the 
storage device 4 of the image processing apparatus in- 
cluding a buffer memory having a large capacity can be 
provided as data that is very easy to use which is ob- 
tained when encoding multivalue image data input to the 
input apparatus according to discrete wavelet transform 
independently in units of a block. Accordingly, it is very 
efficient when it is intended to perform image editing in- 
dividually for each partial region smaller than one picture' 
frame in two-dimensional directions. 
[0068] Next, a description will be provided of a proce- 
dure when outputting encoded data stored in the stor- 
age device 4 to an external output apparatus 6. 
[0069] In FIG. 1, encoded data stored in the storage 
device 4 is output to a second switcher 9 at the succeed- 
ing stage. The basic function of the second switcher 9 
is the same as the above-described first switcher. The 
second switcher 9 performs switching of whether input 
encoded data is to be temporarily output to the code- 
string converter 5 or directly to the external output ap- 
paratus 6. » '* 
[0070] A control input from the external output appa- 
ratus 6 where data is to be output or a manual control 
input from the user is used as the control input to the 
switcher 9 in this case. Information indicating the capac- 
ity of the buffer storage usable by the external output 
apparatus 6 during decoding using inverse wavelet 
transform is adopted as the control input from the exter- 
nal output apparatus 6. When the capacity of the buffer 
storage necessary for inverse wavelet transform by the 
external output apparatus 6 is insufficient based on this 
information, the code-string converter 5 provides ar- 
rangement of encoded data obtained by performing 
wavelet transform of the encoded data in units of a line. 
According to this switching processing, it is possible to 
output encoded data according to wavelet transform 
having an optimum data format (arrangement) in ac- 
cordance with whether endoded data decodable by the 
external output apparatus 6 has been obtained after 
wavelet transform in units of a line or in units of a block. 
[0071] Next, the operation of the code -string convert- 
er 5 will be described with reference to FIGS. 6A - 6C. 
The code-string converter 5 converts encoded data ob- 
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tained by wavelet transform in units of a block into a data 
arrangement of encoded data obtained by wavelet 
transform in units of a line. As shown in FIG. 6A, the 
code-string converter 5 includes an entropy decoder 
501 , a coefficient arranger 502, and an entropy encoder 
503. 

[0072] The input encoded data is decoded by the en- 
tropy decoder 501 . Since the encoded data at that time 
is encoded in units of a block as shown in FIG. 5D, de- 
coded quantized values are configured in units of a 
block. The coefficient arranger 502 at the succeeding 
stage arranges the quantized values in units of a block 
thus obtained so that quantized values belonging to the 
same subband are arranged in units of a line over a se- 
ries of blocks, and outputs the arranged quantized val- 
ues to the entropy encoder 503 at the succeeding stage 
when the quantized values for one line of the input im- 
age are provided. 

[0073] FIG. 6B illustrates the manner of this opera- 
tion. In this description, it is assumed that the image in- 
cludes eight blocks in the horizontal blocks. Quantized 
values belonging to respective subbands are read for a 
length corresponding to one line of the image from the 
eight blocks, to provide quantized values in units of a 
line. 

[0074] The entropy encoder 503 performs entropy en- 
coding of the input quantized values in units of a line, 
and outputs resultant data. FIG. 6C illustrates an exam- 
ple of encoded data at that time. In FIG. 6C, a header 
includes information, such as the size of the input mul- 
tivalue image data, the number of color components, a 
flag indicating that encoding is performed in units of a 
line, and the like. In this case, a flag indicating the unit 
of encoding stored in the header information as shown 
in FIG. 4C is rewritten. 

[0075] After the header, encoded data obtained by en- 
coding respective lines of the image according to the 
above-described method are sequentially arranged 
from the first line. 

[0076] In the first embodiment, quantized values cor- 
responding to each line are subjected to entropy encod- 
ing independently for each line. Namely, the encoding 
operation of the entropy encoder 503 is reset in units of 
a line. 

[0077] However, the present invention is not limited to 
such an approach. Quantized values corresponding to 
each line may be subjected to entropy encoding not 
completely independently. Namely, when executing 
arithmetic encoding, the encoding operation of the en- 
tropy encoder 503 may not be reset in units of a line, 
and may continue for a few lines in the order of raster 
scanning. It is thereby possible to perform compression 
encoding with a higher compression ratio by utilizing 
overall correlation of the original multivalue image. 
[0078] This configuration is the same as the encoded 
data shown in FIG. 3C, which is obtained by performing 
discrete wavelet transform in units of a line. Accordingly, 
the capacity of the memory for operation required during 



decoding can be minimized. 

[0079] The configuration of the external output appa- 
ratus is shown in FIG. 7. The input encoded data is read 
into a buffer for decoding 601 and is decoded by an en- 
5 tropy decoder 602, and obtained quantized values are 
output to an inverse quantizer 603 at the succeeding 
stage. The inverse quantizer 603 performs inverse 
quantization of the input quantized values, and outputs 
a coefficient string provided by discrete wavelet trans- 
it form. This coefficient string is written into a buffer stor- 
age 604, and is subjected to inverse transform by an 
inverse discrete wavelet transformer 605 to restore an 
original image, which is output. This inverse transform 
is inverse to the procedure of forward-direction trans- 
it form shown in FIG. 3B. 

[0080] As described above, it is possible to output en- 
coded data in an optimum format (arrangement) encod- 
ed using discrete wavelet transform to both an appara- 
tus which has a sufficient capacity of a buffer storage 
20 necessary for inverse discrete wavelet transform by the 
external output apparatus 6, and an apparatus which 
has an insufficient capacity of the buffer storage. 

Second Embodiment 

25 

[0081] Although in the above-described first embodi- 
ment, the image processing apparatus according to the 
present invention receives encoded data obtained by 
compressing an image as an external input, a second 
30 embodiment of the present invention has a different con- 
figuration. 

[0082] FIG. 2 is a block diagram illustrating the con- 
figurations of an image processing apparatus according 
to the second embodiment, and an image input/output 

35 system using the apparatus. 

[0083] In FIG. 2, portion E2 represents a block dia- 
gram of the image processing apparatus for changing 
data arrangement in accordance with an external output 
apparatus 6. An image input apparatus 7 receives or 

40 generates multivalue image data with a predetermined 
method, digitizes the image data, and outputs multival- 
ue digital image data. 

[0084] The image processing apparatus E2 encodes, 
in image encoder 8, the multivalue image data output 
4S from the image input apparatus 7, temporarily stores re- 
sultant data in a storage device 4, and outputs the stored 
data to an external output apparatus 6 as encoded data 
whenever necessary. 

[0085] For example, a system including the image in- 
so put apparatus 7 and the image processing apparatus 
E2 corresponds to an image input apparatus, such as a 
digital camera, a scanner or the like. The system tem- 
porarily stores an input image, and outputs the stored 
data to an external computer or printer, or the like, when- 
5s ever necessary. 

[0086] The function of each block will now be de- 
scribed. Although in the following description, image da- 
ta is assumed to be data representing gray-scale black- 
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and-white image, the present invention is not limited to 
such data. For example, the present invention may be 
applied to a case of processing data of a color image 
having a plurality of color components. In this case, the 
same effects as in the following description may be ob- 
tained by performing processing for black-and-white im- 
age data to be described below to each color data. 
[0087] The multivalue image data output from the im- 
age input apparatus 7 is input to an image encoder 8, 
and is subjected to compressing encoding. FIG. 8 is a 
block diagram illustrating the configuration of the image 
encoder 8. In FIG. 8, the input multivalue image data is 
temporarily stored in a buffer storage 801, and is then 
subjected to discrete wavelet transform by a discrete 
wavelet transformer 802. The transform at that time is 
performed either in units of a line as described with ref- 
erence to FIGS. 3A - 3C, or in units of a block as de- 
scribed with reference to FIGS. 4A-4C, in the first em- 
bodiment. 

[0088] A series of transform coefficients obtained by 
the transform operation of the discrete wavelet trans- 
former 802 are quantized by a quantizer 803 at the suc- 
ceeding stage. Obtained quantized values are output to 
a buffer storage for encoding 804. 
[0089] An entropy encoder 805 performs entropy en- 
coding for the quantized values stored in the buffer stor- 
age for encoding 804, and outputs encoded data to a 
storage device 4 at the succeeding stage. The output 
encoded data is either indenpedent in units of a line as 
shown in FIG. 3C, or independent in units of a block as 
shown in FIG. 4C. 

[0090] The procedure when outputting the encoded 
data stored in the storage device 4 is the same as in the 
first embodiment. Namely, the encoded data output from 
the storage device 4 is switched by a switcher 2 in ac- 
cordance with input of information indicating data ar- 
rangement from an external output apparatus 6 or the 
user, so as to determine whether the data is to be first 
output to a code-string converter 5 or directly to the ex- 
ternal output apparatus 6. 

[0091] The code-string converter 5 converts the en- 
coded data from the storage device 4 into encoded data 
having a data arrangement decodable with the capacity 
of a buffer storage provided in the external output appa- 
ratus 6. 

[0092] Namely, when the encoded data from the stor- 
age device 4 is obtainded by performing wavelet trans- 
form in units of a block as described with reference to 
FIGS. 4A - 4C, and the capacity of the buffer storage 
usable during decoding by the external output appara- 
tus 6 where the encoded data is to be output is small 
and encoded data obtained by performing wavelet 
transform in units of a line as described with reference 
to FIGS. 3A - 3C can be decoded, data arrangement of 
the encoded data is converted using the code-string 
converter 5 according to the method described with ref- 
erence to FIGS. 6 A - 6C. 

[0093] On the other hand, when the encoded data 



from the storage device 4 is obtainded by performing 
wavelet transform in units of a line as described with ref- 
erence to FIGS. 3A - 3C, and the capacity of the buffer 
storage usable during decoding by the external output 
s apparatus 6 where the encoded data is to be output is 
relatively large and encoded data obtained by perform- 
ing wavelet transform in units of a block as described 
with reference to FIGS. 4A - 4C can also be decoded, 
data arrangement of the encoded data is converted us- 
ing the code-string converter 5 according to the method 
described with reference to FIGS. 5A - 5D. 
[0094] When the encoded data from the storage de- 
vice 4 is obtained by performing wavelet transform in 
units of a line as described with reference to FIGS. 3A 
- 3C, and the capacity of the buffer storage usable during 
decoding by the external output apparatus 6 where the 
encoded data is to be output is small, and only encoded 
data obtained by performing wavelet transform in units 
of a line as described with reference to FIG. 3A - 3C can 
be decoded, or when the encoded data from the storage 
device 4 is obtainded by performing wavelet transform 
in units of a block as described with reference to FIGS. 
4A - 4C, and the capacity of the buffer storage usable 
during decoding by the external output apparatus 6 
where the encoded data is to be output is relatively large 
and encoded data obtained by performing wavelet- 
transform in units of a block as shown in FIGS. 4A - 4C 
can also be decoded, the encoded data is directly output 
from the switcher 2 to the external output apparatus 6. 

Other Embodiments 

[0095] In the above -described embodiments, the ex- 
ternal input apparatus and the external output apparatus 
correspond to an image input apparatus, such as a dig- 
ital camera or the like, and an image output apparatus; 
such as a printer or the like, respectively. However, ap- 
paratuses having the same configurations as the image 
processing apparatuses E1 and E2 may be used as the 
external input apparatus and the external output appa- 
ratus, respectively. 

[0096] The image processing apparatus E1 or E2 may 
be directly connected to the external input apparatus 
and the external output apparatus via a cable or the like, 
or via a network. 

[0097] The present invention is not limited to the ap- 
paratus and the method for realizing each of the above- 
described embodiments, but may also be applied to a 
case in which the above-described embodiments are re- 
alized by supplying a computer (a CPU (central process- 
ing unit) or an MPU (microprocessor unit)) within the 
system or the apparatus with program codes of software 
for realizing the above-described embodiments, and op- 
erating the above-described devices by the computer of 
the apparatus or the system in accordance with the pro- 
gram codes. 

[0098] In such a case, the program codes themselves 
of the software realize the functions of the above-de- 
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scribed embodiments, so that the program codes them- 
selves, means for supplying the computer with the pro- 
gram codes, more spefically, a storage medium storing 
the program codes, constitute the present invention. 
[0099] For example, a floppy disk, a hard disk, an op- 
tical disk, a magnet ooptical disk, a C D (compact -disc) - 
ROM(read-only memory), a magnetic tape, a nonvola- 
tile memory card, a ROM or the like may be used as the 
storage medium storing the program codes. 
[01 00] The program codes also constitute the present 
invention not only when the functions of the above-de- 
scribed embodiments are realized by controlling the re- 
spective devices by the computer only in accordance 
with the supplied program codes, but also when the 
above -described embodiments are realized by cooper- 
ation of the program codes with an OS (operating sys- 
tem) operating in the computer, another application soft- 
ware, or the like. 

[0101] The present invention may also be applied to 
a case in which, after storing the supplied program 
codes in a memory provided in a function expanding 
board of a computer or in a function expanding unit con- 
nected to the computer, a CPU or the like provided in 
the expanding board or the function expanding unit per- 
forms a part or the entirety of actual processing based 
on instructions of the program codes, and the functions 
of the above-described embodiments are realized by 
the processing. 

[0102] As described above, according to the present 
invention, it is possible to change image data encoded 
using discrete wavelet transform into an optimum data 
arrangement which can be efficiently dealt with in each 
apparatus. 

[0103] Particularly when dealing with image data en- 
coded using discrete wavelet transform, it is possible to 
obtain image data having an optimum data arrangement 
in which the capacity of a memory provided in an appa- 
ratus dealing with the image data is taken into consid- 
eration. On the other hand, when dealing with image da- 
ta encoded using discrete wavelet transform so as to be 
adapted to an apparatus having a small memory capac- 
ity, it is possible to arrange image data so as to easily 
perform various types of image processing in a desired 
two-dimensional region. 

[0104] The individual components designated by 
blocks in the drawings are all well known in the image 
processing apparatus and method arts, and their spe- 
cific construction and operation are not critical to the op- 
eration or the best mode for carrying out the invention. 
[0105] While the present invention has been de- 
scribed with respect to what are presently considered to 
be the preferred embodiments, it is to be understood 
that the invention is not limited to the disclosed embod- 
iments. To the contrary, the present invention is intended 
to cover various modifications and equivalent arrange- 
ments included within the spirit and scope of the ap- 
pended claims. The scope of the following claims is to 
be accorded the broadest interpretation so as to encom- 



pass all such modifications and equivalent structures 
and functions. 



£ Claims 

1. An image processing apparatus, characterized in 
that it comprises: 

10 input means for inputting first entropy encoded 

data corresponding to an image, the first entro- 
py encoded data comprising data produced by 
entropy encoding a first set of transform coeffi- 
cients obtained by performing wavelet trans- 

15 form of the image in units of a first type; 

arrangement changing means for entropy de- 
coding the first entropy encoded data to obtain 
the first set of transform coefficients, and for 
changing the first set of transform coefficients 

20 into a second set of transform coefficients cor- 

responding to the result of performing wavelet 
transform of the image in units of a second type; 
and 

entropy encoding means forage ne rating second 
25 entropy encoded data by entropy encoding the 

second set of the transform coefficients. 

2. An apparatus according to Claim 1 , wherein the first 
type of unit comprises a predetermined number of 

30 lines, and wherein the second type of unit compris- 
es one block having a size smaller than one picture 
frame in two dimensions. 

3. An apparatus according to Claim 2, wherein the first 
35 type of unit comprises one line. 

4. An apparatus according to Claim 1 , wherein the first 
type of unit comprises a block having a size smaller 
than one picture frame in dimensions, and wherein 

40 the second type of unit comprises a predetermined 
number of lines. 

5. An apparatus accoring to Claim 4, wherein the sec- 
ond type of unit comprises one line. 

45 

6. An apparatus according to Claim 1 , wherein the en- 
tropy encoding comprises arithmetic encoding. 

7. An apparatus according to Claim 1, wherein said 
so input means inputs the first entropy encoded data 

from an external apparatus, and wherein said ar- 
rangement changing means determines whether or 
not to decode the first entropy encoded data and to 
change the first set of transform coefficients, in ac- 
55 cordance with a capacity of a buffer memory re- 
quired during an encoding operation of the external 
apparatus. 
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8. An apparatus according to Claim 1 , further compris- 
ing output means for outputting the second entropy 
encoded data to an external apparatus, and 

wherein said arrangement changing means 
determines whether or not to decode the first entro- 
py encoded data and to change the first set of trans- 
form coefficients, in accordance with a capacity of 
a buffer memory required during a decoding oper- 
ation of the external apparatus. 

9. An apparatus according to Claim 1, wherein said 
arrangement changing means determines whether 
or not to decode the first entropy encoded data and 
to change the first set of transform coefficients, in 
accordance with input of a predetermined instruc- 
tion. 

10. An apparatus according to Claim 9, wherein said 
input means inputs the first entropy encoded data 
from an external apparatus, and wherein the prede- 
termined instruction is input from the external appa- 
ratus. 

11. An apparatus according to Claim 9, further compris- 
ing output means for outputting the second entropy 
encoded data to an external apparatus, and 

wherein the predetermined instruction is input 
from the external apparatus. 

1 2. An apparatus according to Claim 9, wherein the pre- 
determined instruction is provided according to a 
manual operation from the user. 

1 3. An apparatus according to Claim 1 , further compris- 
ing means for obtaining the first entropy encoded 
data by performing wavelet transform of the image 
in units of a first type to obtain the first set of trans- 
form coefficients and then entropy encoding the first 
set of transform coefficients. 

14. An apparatus according to Claim 1 , further compris- 
ing an additional arrangement changing means for 
performing entropy decoding of the second entropy 
encoded data to obtain the second set of transform 
coefficients, and for changing the second set of 
transform coefficients into a third set of transform 
coefficients corresponding to the result of perform- 
ing wavelet transform of the image in units of a third 
type, and 

Additional entropy encoding means for gen- 
erating third entropy encoded data by entropy en- 
coding the third set of transform coefficients. 

15. An apparatus according to Claim 14, wherein said 
arrangement changing means determines whether 
or not to decode the first entropy encoded data and 
to change the first set of transform coefficients, in 
accordance with a signal input from an external ap- 



paratus. 

16. An apparatus according to Claim 15, further com- 
prising output means for outputting the third entropy 

5 encoded data to an external apparatus, and 

wherein said additional arrangement chang- 
ing means determines whether or not to decode the 
second entropy encoded data and to change the 
second set of transform coefficients, in accordance 

10 with a signal input from the additional external ap- 
paratus. 

17. An apparatus according to Claim 16, wherein the 
third type of unit is the same as the first type of unit. 

15 

18. An image processing method, characterized in that 
it comprises: 

an input step of inputting first entropy encoded 
20 data corresponding to an image, the first entro- 

py encoded data comprising data produced by 
entropy encoding a first set of transform coeffi- 
cients obtained by performing wavelet trans- 
form of the image in units of a first type; 
25 an arrangement changing step of entropy de- 

coding the first entropy encoded data to obtain 
the first set of transform coefficients, and of 
changing the first set of transform coefficients 
into a second set of transform coefficients cor- 
30 responding to the result of performing wavelet 

transform of the image in units of a second type; 
and 

an entropy encoding step of generating second 
entropy encoded data by entropy encoding the 
35 second set of transform coefficients. 

19. An image processing method according to Claim 
18, wherein the first entropy encoded data is input 
in said input step from an external apparatus, and 

40 wherein it is determined in said arrangement chang- 
ing step whether or not to decode the first entropy 
encoded data and to change the first set of trans- 
form coefficients, in accordance with a capacity of 
a buffer memory required during an encoding oper- 

45 ation of the external apparatus. 

20. An image processing method according to Claim 
18, further comprising an output step of outputting 
the second entropy encoded data to an external ap- 

50 paratus, and 

wherein it is determined in said arrangement 
changing step whether or not to decode the first en- 
tropy encoded data and to change the first set of 
transform coefficients, in accordance with a capac- 

55 ity of a buffer memory required during a decoding 
operation of the external apparatus. 

21. An image processing method according to Claim 
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18, wherein it is determined in said arrangement 
changing step whether or not to decode the first en- 
tropy encoded data and to change the first set of 
transform coefficients, in accordance with input of 
a predetermined instruction. 

22. An image processing method according to Claim 
1 8, further comprising an obtaining step of obtaining 
the first entropy encoded data by performing wave- 
let transform of the image in units of a first type to 
obtain the first set of transform coefficients and then 
entropy encoding the first set of transform coeffi- 
cients. 

23. A storage medium storing an image processing pro- 
gram in a state of being readable by a computer, 
characterized in that said program comprises: 



26. A storage medium according to Claim 23, wherein 
in said program it is determined in said arrangement 
changing step whether or not to decode the first en- 
tropy encoded data and to change the first set of 

s transform coefficients, in accordance with input of 
a predetermined instruction. 

27. A storage medium according to Claim 23, said pro- 
gram further comprising an obtaining step of obtain- 

10 ing the first entropy encoded data by performing 
wavelet transform of the image in units of a first type 
to obtain the first set of transform coefficients and 
then entropy encoding the first set of transform co- 
efficients. 

15 



an input step of inputting first entropy encoded 
data corresponding to an image, the first entro- 20 
py encoded data comprising data produced by 
entropy encoding a first set of transform coeffi- 
cients obtained by performing wavelet trans- 
form of the image in units of a first type; 
an arrangement changing step of entropy de- 25 
coding the first entropy encoded data to obtain 
the first set of transform oefficients, and of 
changing the first set of transform coefficients 
into a second set of transform coefficients cor- 
responding to the result of performing wavelet 30 
transform of the image in units of a second type; 
and 

an entropy encoding step of generating second 
entropy encoded data by entropy encoding the 
second set of transform coefficients. 3s 



24. A storage medium according to Claim 23, wherein 
in said program the first entropy encoded data is 
input in said input step from an external apparatus, 
and wherein in said program it is determined in said 40 
arrangement changing step whether or not to de- 
code the first entropy encoded data and to change 

the first set of transform coefficients, in accordance 
with a capacity of a buffer memory required during 
an encoding operation of the external apparatus. 

25. A storage medium according to Claim 23, said pro- 
gram further comprising an output step of outputting 
the second entropy encoded data to an external ap- 
paratus, and so 

wherein in said program it is determined in 
said arrangement changing step whether or not to 
decode the first entropy encoded data and to 
change the first set of transform coefficients, in ac- 
cordance with a capacity of a buffer memory re- 55 
quired during a decoding operation of the external 
apparatus. 
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